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Abstract 

The goal of this paper is to develop a general approach to solution of ill-posed 
nonlinear problems in a Hilbert space based on continuous processes with a regular- 
ization procedure. To avoid the ill-posed inversion of the Frechet derivative operator a 
regularizing one-parametric family of operators is introduced. Under certain assump- 
tions on the regularizing family a general convergence theorem is proved. The proof 
is based on a lemma describing asymptotic behavior of solutions of a new nonlinear 
integral inequality. Then the applicability of the theorem to the continuous analogs of 
the Newton, Gauss-Newton and simple iteration methods is demonstrated. 
AMS subject classification: Primary: 47H17. Secondary; 65J15, 58C15. 



1 Introduction 



Let us consider a nonlinear operator equation 



F{z) = 0, F -.H ^ H, 



(1.1) 



in a real Hilbert s pace H (equation ( p~ll ) in a complex Hilbert space can be treated similarly). 

Assume that (IT) is solvable (not necessarily uniquely). If the Frechet derivative of the 
operator F has nontrivial null-space at the solution to (1.1), then one can use the classical 
Newton method for solution to ( |l.l| ) only under some strong assumptions on the operator 
F (see [^l], ^). Otherwise in order to construct a numerical method for solution to (IT) one 
needs some regularization procedure. 

In the theory of ill-posed problems many different discrete methods based on a regu- 
larization are known. Many different convergence theorems for such schemes describe the 



efficiency of tlie numerical algorithms for solving various nonlinear problems, and give ex- 
istence results (see, for example, |l^, ^). However it is quite difficult to navigate in 
the sea of the discrete schemes and corresponding convergence theorems. Proofs of these 
theorems are usually based on the contraction mapping principle and are sometimes rather 
complicated. 

On the other hand an analysis of continuous processes is based on the investigation of 
the asymptotical behavior of nonlinear dynamical systems in Banach and Hilbert spaces. If 
a convergence theorem is proved for a continuous method, one can construct various discrete 
schemes generated by this continuous process. Thus construction of a discrete numerical 
scheme is split into two parts: construction of the continuous process and numerical integra- 
tion of the corresponding nonlinear operator differential equation. Convergence theorems 
for regularized continuous Newton- like methods are established in H, ^, |l^ . 

The goal of this paper is to develop a general approach to continuous analogs of discrete 
methods and to establish fairly general convergence theorem. This approach is based on 
an analysis of the solution to the Cauchy problem for a nonlinear differential equation in 
a Hilbert space. Such an analysis was done for well-posed problems in where it was 
based on a usage of an integral inequality. It is more difficult to study nonlinear ill-posed 
problems. In this case one has to use more complicated new integral inequality (Lemma |2.2D . 
Based on Lemma 2.2 the general theorem establishing convergence of a regularized contin- 
uous process is proved (Theorem 2.4). Applying this theorem to the regularized Newton's 
and simple iteration methods (for monotone operators) and to Gauss-Newton-type methods 
(for non-monotone operators) convergence theorems are obtained under less restrictive con- 
ditions on the equation than the theorems known for the corresponding discrete methods. 
According to these theorems one can choose a regularizing operator depending on the "de- 
gree of degeneracy" of the original nonlinear problem and estimate the rate of convergence 
of the regularized process. 

The paper is organized as follows. In Section 2 Lemma 2.2 about the solution of a 
new integral inequality and Theorem 2A about the convergence of a regularized continuous 
process are formulated and proved. In Section 3 this theorem is applied to continuous 
Newton's and simple iteration methods and in Section 4 to the Gauss-Newton-type methods. 
A practically interesting numerical example is considered in Section 5. A lemma about 
nonlinear differential inequality is proved in the Appendix. 



2 Regular izat ion procedure 

In the well-posed case (the Frechet derivative F' of the operator is a bijection in a 
neighborhood of the solution of equation (1.1)) in order to solve equation (1.1) one can 
use the following continuous processes: 

• simple iteration method: 



z{t) = -F{z{t)), z(0) ^zoeH, 



(2.1) 
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• Newton's method: 

z{t)^-[F'{zm-^F{z{t)), z{0) = zoeH, (2.2) 

• Gauss-Newton's method: 

i{t) = -[F'*{z{t))F'{z{t))r^F'*{z{t))F{z{t)), z{Q) = zoGH, (2.3) 

or some of their modifications (see ||f|, ) . 

Ho weve r if F' is not continuously invertible (ill-posed case) one has to replace equations 
(2.1) -(2.3) by the corresponding regularized equations: 

• regularized simple iteration method: 

m = -[F{<t))+e{t){z{t)-zo)], z{0)^zoeH, (2.4) 

• regularized Newton's method: 

m = -[F'{z{t)) + eit)I]-'[F{z{t))+e{t){zit) ~ zq)], z(0) ^ zo e H, (2.5) 

• regularized Gau ss-Newton's methods: equation ( p^ ) with the function <i> defined in 
(^) or in dJI), 

with an appropriate choice of the function e{t) and the point zq. Here / is the identity 
operator. 

The goal of this paper is to develop a uniform approach to such regularized methods. 
Let us consider the Cauchy problem: 

z{t) = <P{z{t),t), z{0) = zoeH, (2.6) 

with an operator $ : _ff x [0,oo) H. The choice of $ yields the corresponding continuous 
process. 

In this section a general convergence theorem (Theorem 2.4) is established. In the 
next two sections the convergence theorems for the processes mentioned above are derived 
from this general theorem. In the proof of the general theorem the technique of integral 
inequalities is used. 

The following lemma is known. It is a version of some results concerning integral in- 
equalities (see e.g. Theorem 22.1 in [^). For convenience of the reader and to make the 
presentation essentially self-contained we include a proof. 

Lemma 2.1 Let f{t,w), g{t,u) be continuous on region [0,T) x D (D d R, T < oo) and 
/(^jW^) l£ g{tiu) if w < u, t (z (0,T), w,u€ D. Assume that g(t,u) is such that the Cauchy 
problem 

u^g{t,u), u(0) = -uo, uo e D (2.7) 

has a unique solution. If 

w < f{t, w), w{0) =wo< ua, Wo £ D, (2.8) 
then u{t) > w{t) for all t for which u{t) and w{t) are defined. 
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Proof Step 1. Suppose first f{t,w) < g{t,u), if w < u. Since wq < uq and w{0) < 
f{t,wo) < g{t,UQ) — u(0), there exists S > such that u{t) > w{t) on {0,6]. Assume that 
for some ti > S one has u{ti) < ■w{ti). Then for some t2 < ti one has 

u{t2) — w{t2) and u{t) < w{t) for t e (^2,^1]- 

One gets 

Wit2) > Uit2)=git,u{t2)) > f{t,w{t2)) > W{t2). 

This contradiction proves that there is no point ^2 such that ^(^2) = w(t2). 
Step 2. Now consider the case f{t, w) < g{t, it), if w < m. Define 

u„ = 5i(i,-u„) + £„, u„(0) = uo, e„ > 0, n = 0, 1,..., 

where e„ tends monotonically to zero. Tlicn 

w < f{t, w) < g{t, u) < g{t, u) + En, w < u. 

By Step 1 Un(t) > w{t), n — 0,1, ... . Fix an arbitrary compact set [0,Ti], < Ti < T. 

t 

Unit) = Mo + / g{T,Un{T))dT + (2.9) 



Since g{t,u) is continuous, the sequence {un\ is uniformly bounded and equicontinuous on 
[0,ri]. Therefore there exists a subsequence {un^} which converges uniformly to a continu- 
ous function u{t). By continuity of g{t, u) we can pass to the limit in (2.9) and get 

t 

u{t) = uo + J g{T, u{T))dT, t e [0, Ti]. (2.10) 



Since Ti is arbitrary ( 2.10| ) is equivalent to the initial Cauchy problem that has a unique 
solution. The inequality Un^{t) > w(t), k — 0,1, ... implies u{t) > w{t). If the solution to 
the Cauchy problem (2.7) is not unique, the inequality w(t) < u(t) holds for the maximal 
solution to (p7|). □ 

Our second lemma is a key to the basic result of this section, namely to Theorem p^ . 

Lemma 2.2 Letj{t),a{t),f3{t) e C[0,oo). If there exists a positive function fi{t) e C^[0,oo) 
such that 

o<.m< if (7(0-^1), ,,(,)< 5^ (,(0-^), MOMOXi. (2,11) 

then a nonnegative solution to the following inequality 

v{t) < --/{t)v{t) + a{ty{t) + f3{t). (2.12) 

satisfies the estimate: 

v{t) < (2.13) 
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Remark 2.3 Without loss of generality one can assume (3{t) > 0. 

In ^ (see also Appendix) a differential inequality ii < —a(t)'>p{u(t)) + b{t) was studied 
under assumptions 1) - 3) of Lemma 6.1 of the Appendix. These assumptions alone, as we 
show in the Appendix, do not imply the desired conclusion 1^6.^ . We have added assumption 
4) in order to prove conclusion \6.^ . In Lemma the term —^{t)v{t) + a{t)v'^{t) (which 
is analogous to some extent to the term —a{t)ip(u{t))) can change sign. Our Lemma is 
not covered by the result in In particular, in Lemma \2.^ an analog of il){u), for the case 
j{t) = (t(<) = a(t), is the function ijj{u) :— u — u} . This function goes to ~oo as u goes to 
+00, so it does not satisfy the positivity condition imposed in 

Unlike in the case of Bihari integral inequality (J^) one cannot separate variables in the 
right hand side of inequality ( 2.1i ) and estimate v{t) by a solution of the Cauchy problem for 
a differential equation with separating variables. The proof below is based on a special choice 
of the solution to the Riccati equation majorizing a solution of integral inequality ( 2.1^ . 



Proofof Lemma 2.2 Denote 



w{t) ■.= v{t)eIo^^''>''% 



then ( 2.12| ) implies: 
where 



!{t) <a{t)w^{t) + b{t), w(0) = w(0), 



(2.14) 
(2.15) 



a{t) - a{t)e- So ^^^^'^^ b{t) = /3(i)e/o 
Consider Riccati's equation: 



m 
fit)' 



(2.16) 



One can check by a direct calculation that the the solution to problem (2. IE) is given by the 
following formula fl^, eq. 1.33]: 



-I -1 



Define / and g as follows: 

fit) ■.= ^,iit)e-if>'•^^'\ git) :^ -^.-^ (t)ei /o ^(^)'^^ 



(2.17) 



(2.18) 



and consider the Cauchy problem for equation (2.16) with the initial condition w(0) = t'(O). 
Then C in (|2.17]) takes the form: 



C 



1 



From ( ^.11 ) one gets 



9it) fit) 
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Since fg=—l one has: 



Thus 



u{t) 



9i^)Pi< 



■ds = - 



/i(s) 



ds. 



1 - M(0)i'(0) 2 7o 



7(s) 



ds 



(2.19) 



It follows from condition (2.11) that the solution to problem (2.16) exists for alH G [0,oo) 
and the following inequality holds: 



1 > 1 



1 



1 



1 - m(0)«(0) 2 Jo 



7(s) 



ds > niO)v{0). (2.20) 



From Lemma 2.1 and from formula (2.19) one gets: 



„(i)e/o'^(^)'^^ := wit) < u{t) < ^re^o 



(2.21) 



and thus estimate ( 2.13 ) is proved. □ 

Examples. To illustrate co nditio ns ( 2.11 ) of Lemma ^ . 2| consider the following examples 
of functions 7, a, (3, satisfying ( 2.11 ). 

1. Let 

j{t)^ci{l + tr\ a{t)^C2{l+tr, /?(<) =C3(l + ^)"^ (2.22) 

where C2 > 0, C3 > 0. Choose fi{t) := c(l + ty , c > 0. From ( ^.ll[ ) one gets the following 
conditions 



C2 < ^{i+tr+'''-''- - |^(i+i)--i-^ 



Cl 



C3 < ^(1 + tr-''-''^ - -(1 + ty-'-'-^, CV{0) < 1. 

Thus one obtains the following conditions: 

1^1 > ~l, V2 — vi < V < Vl — V3, 

and 

2C2 Cl — v 

Cl > J/, —<c<^ , cw(0) < 1. 

Cl ~ v 2c3 

Therefore for such 7, cr, /? a function with the desired properties exists if 



and 



vi > -1, 1^2 + 1^3 < 2!^l, 



Cl > J/2 - i^l, 2^C2C3 < Cl + I/i - Z^2, 2C2W(0) < Ci + I/i - i^2- 



(2.23) 

(2.24) 
(2.25) 

(2.26) 
(2.27) 
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In this case one can choose v = 1^2 — i^i, c = — — . However in order to have v(t) 
as t ^ +00 (the case of interest in Theorem 2.4) one needs the following conditions: 



and 



2. If 



Ci>l'2-Vl, 2^C2C3 < Ci, 2C2W(0)<C1. 



(2.28) 
(2.29) 



then conditions (2.11) are satisfied if 



0<tTo < ^(70-i^), Po<^ilo-iy), /io«(0)<l. 



3. If 



^log(i + to) 



fi{t) = c\og{t + to), 



then conditions ( 2.11 ) are satisfied if 

0<a(0<|(v/bi(rTM-^), 

^(^^ Sclog4 + to) (^^^^^(^-^)' -W^l°g^o<l- 

In all considered examples /x(t) can tend to infinity as i — > +00 and provide a decay of 
a nonnegative solution to integral inequality ( p. 12 ) even if <7{t) tends to infinity. Moreover 
in the first and the third examples v{t) tends to zero as t — > +00 when j{t) and 
a{t) +00. 

Theorem 2.4 Let $(/i, t) be Frechet differ entiahle with respect to h and satisfy the following 
condition: 

there exists a differentiable function x{t), x : [0, +00) H , such that for any h ^ H, t ^ 
[0,+oo) 

mh,t),h^x{t)) < a{t)\\h-x{t)\\--f{t)\\h-x{t)\\^ +a{t)\\h^x{t)\\'^, (2.30) 



where a{t) is a continuous function, a{t) > 0, ^{t) and a{t) satisfy conditions (2.11) of 
Lemma \2.^ with 

/3(t) :=||i(i)||+a(i), t^(0) := | |zo - x(0)| |, vit) := \\z{t) - x{t)\\, (2.31) 

and ii{t) tends to +00 as t ^ +00. 

Then problem {2.t ) has a unique solution zit) defined for all t e [0,cxd), and 



\\z{t) - x{t)\\ < lim ||z(0-x(t)||=0. 

^{t) 



(2.32) 
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Remark 2.5 One can choose the regularizing operator ^{h,t) in such that condition 

(2.3C) holds in the case when F'*[h)F'{h) is not houndedly invertible (see Sect. 3). 



Proof of Theorem |2.4| Since ^{h,t) is Frechet difFerentiable with respect to h there 
exists the solution to problem (2.6) on the maximal interval [0, Ti) of the existence of the 
solution to One has to show that Ti = +oo. Assume Ti < +oo. Since H is a. real 

Hilbert space one has: 



1 d 
2di 



\\z{t) - x{t)\f = (i - i, z{t) - x{t)) = mz{t),t), z{t) - x{t)) - (x, z{t) - x{t)). (2.33) 



Therefore from ( |2.30| ) and ( |2.3l| ) one obtains 
1 d 



2 dt 
Denote 



\\z{t) - xm' < -iMt) - <t)\\' + <rmm - + mim - ^m. (2.34) 



From ( p34| ) one has: 



If > 0, one gets: 



v{t) ■.^\\z{t)~x{t)\\. 



v{t)ij(t) < -j{t)v'^{t) + cr{t)v^{t) + f3{t)v{t). 



v{t) < -l{t)v{t) + a{t)v^{t) + (3{t). 



(2.35) 

If ti = on some interval, then inequality ( 2.35| ) is satisfied trivially because l3{t) > 0. Thus 
(|3|) holds for aU t > 0. 

By Lemma p.2| one obtains 



Mt)-x{t)\\< 



^,{ty 



for te[0,Ti) 



(2.36) 



From ( ^.36| ) one concludes that z{t) does not leave the ball Bi centered at xit) with radius 
(miujgjg /Lt(i))~^ > 0. Since maxo<t<Ti | |2;(i)| | < oo, one concludes that supq<j<7i^ I k(i)l I < 
00. Therefore there exists a sequence {t„} — > Ti such that {z{tn)} converges weakly to some 
z. From equation ( |2.6D one derives the uniform boundedness of the norm ||i(t)|| on [0,Ti). 
Thus there exists livnt—tTi \ \z{t) — z\ \ = 0. Since the conditions for the uniqueness and local 
solvability of the Cauchy problem for equation (2.6) with initial condition z{Ti) = z are sat- 
isfied, one can continue the solution to (2.6) through Ti. This contradicts the assumption 
of maximality of Ti, thus Ti = +oo. Moreover, from (2.13) one gets: 



hm ||z(t)-x(t)|| < lim ^ =0. 



(2.37) 



□ 
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3 Regularized Continuous Methods 
for Monotone Operators 

In this section we apply the regularization procedure described in Sect. 2 to solve nonlinear 



operator equation (1.1). Assume that F is Frechet differentiable and 

iF'ih)^,^)>0 foraU h,^eH. (3.1) 

Under this assumption the operator F'{h) + e{t)I is boundedly invertible. Define $ as 
follows: 

^h,t) :^ -[F'{h) + e{t)I]-'[F{h) + e{t){h ~ zo)], (3.2) 
where zq £ H is an initial approximation point and e(t) is some positive function on the 



interval [0, oo). Some restrictions on e(t) will be stated in Theorem 3.1C. 

An outline of the convergence proof is the following. First one considers an auxiliary 
well-posed problem: 

Fe{x) := F{x) +e{x- zo) = 0, s > 0, (3.3) 

and shows that the difference between its solution x(t) and the solution z{t) to problem 
(P^) tends to zero as i ^ +oo. On the other hand one shows that x{t) converges to the 



exact solution y of equation (1.1). Thus one proves the convergence of z(t) to y as t — s- +00. 



We recall first some definitions from nonlinear functional analysis which are used below. 



The most essential restrictions on the operator F imposed in this section are (3.1) and 
it^continuity of F. In particular they imply monotonicity and hemicontinuity of F. 

Definition 3.1 A mapping if is monotone in a Hilbert space H if 

{ip{xi) - (p{x2),xi - X2) > 0, yxi,X2eH. 

Definition 3.2 A mapping (p is hemicontinuous at xq £ H if the map t — s- ((^(xq + thi), ^,2) 
is continuous in a neighborhood of t = for any hi, hi e H. 

Definition 3.3 A mapping Lp is strongly monotone in a Hilbert space H if there exists a 
constant k > such that 

(ifiixi) - ip{x2),xi - X2) > k\\xi - a;2|p, Vxi,a;2 G H. 



Lemma 3.4 If F is monotone and hemicontinuous then the problem (3.5) is uniquely solv- 
able. 



Proof of Lemma |3.4| According to |lj, p. 100] problem ( |3.3| ) is solvable if the operator 
Fg is monotone, hemicontinuous and [[^^(a;)!! — )■ 00 as ||a;|| —>■ 00. For sufficiently small 
6 > from (^|^) one has: 

mixW > + e'\\x zolP - ^WFM' -S\\x- zolP 
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> [e'' ^ 5)\\x ^ zof - C ^ +c 



as ||x|| +00. Here C is a con stant. Since Fg, is strongly monotone the solution to (3^) is 
unique. Therefore Lemma 3.4 is proved. □ 



Remark 3.5 The result given by Lemma 3.4 is well known and its proof is given for the 
convenience of the reader. 

Let denote weak convergence in H. 

Definition 3.6 We say that F is w-continuous if x implies F[x) F{^). 



Lemma 3.7 Suppose that F is w-continuou s, a ll the assumption s of Lemma \3.^ are satis- 
fied, and there exists a unique solution y to ^l.j) . Let x{t) solve ( 3^ ) for e — e{t), and e{t) 
tend to zero as t —* -\-oo. Then 



hm ||x(t)-y||=0. 

t— S- + 00 



(3.4) 



Proof First let us show that x{t) is bounded. Indeed, it follows from ( p.3[ ) that 
Fix{t)) - F{y) + e{t){x{t) - y) ^ e{t){zo - y). 

Therefore 

{F{x{t)) - F{y),x{t) - y)+e{t)\\x{t) - y\\^ = e{t){zo - y,x{t) - y). (3.5) 
This and (O) imply 



\\x{t)^y\\<\\zo-y\\. (3.6) 

Thus there exists a sequence {x{t„)}, t„ — s- 00 as n — > 00, which converge s we akly to some 
element y d H. Let us show that y is the (unique) solution to problem (1.1). Since F is 
w-continuous, F{x(tn)) F{y)- Because of the weak lower semicontinuity of the norm in a 
Hilbert space one has: 



||F(y)|| <liminf||F(a;(t„))ll -liminf£(t„)||a;(i„)-.2o|| =0. 



(3.7) 



The conclusion F{y) — follows from ( p.7\j and can also be derived directly from ( |3.3| ) with 
e — e{t) a.s t ^ +00. By the uniqueness of the solution to equation (1.1) one concludes 
that y ~ y. Let us show that the sequence {x(t„)} converges strongly to y. Indeed, from 
(p7^), (|3.lD and the relation x{tn) y, one gets: 



Thus 



I \x{tn) - y| P < {zq - y, x{tn) - ?/) ^ as 



lim ||x(t„)-2/|| =0. 



(3.8) 
(3.9) 



From (^) it follows by the standard argument that x{t) ^ y as t ^ oo. Lemma |3J| is 
proved. □ 
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Lemma 3.8 Assume that F is continuously Frechet differentiable, sup^.^^;^ ||i^'(x)|| < A^i, 
and condition (S.l) holds. If e{t) is continuously differentiable, then the solution x{t) to 
problem (pjj with e = e{t) is continuously differentiable in the strong sense and one has 



mil 

e{t) 



\y - zoW, t e [0,+oo). 



(3.10) 



Proof Frechet differentiability of F implies hemicontinuity of F. Therefore problem 



(3.S) with e — e{t) is uniquely solvable. The differ entia bility Qix{t) with respect to t fo llows 
from the implicit function theorem [2]. To derive ( |3.10| ) one differentiates equation (3.3) and 



uses the estimate 



[F'{x{t))+em 



< 



The result is: 



\i{t)\\ = m\ ■ WlF'ixit)) + em-H^it) - ^o)|| < ^Mt) - zo\ 



Here we have used the estimate 



\x{t) - zqW < \\y - zo\ 



(3.11) 



(3.12) 



which can be derived from (3.3) similarly to the derivation of (3.6). Thus estimate (3.10) 
follows from ( |3.1lD and (|3.12D. □ 



Lemma 3.9 Assume that e — e{t) > 0, F is twice Frechet differentiable, condition (3.1) 
holds, and 

\\F'ix)\\<Ni, ||i^"(x)|| <7V2 yxeH. (3.13) 



Then for the operator $ defined by (3.^) and x{t), the solution to (3.S) with e = e{t), 
estimate ( 2.3L ) holds with 



a{t) = 0, 7(t) = 1, and a{t) 



N2 

2e{ty 



(3.14) 



Proof Since x{t) is the solution to ( |3.3D applying Taylor's formula one gets: 
($(/i, t),h - x{t)) = -{[F\h) + e{t)I]-^[F{h:) - F{x{t)) + e{t){h - x{t))],h - x{t)) 



< - \F'{h)^e{t)I\-\F\h)(h~x{t))+e{t)(h-x{t)%h-x{t) +- 



2e{t) 



\h~xm 



2e{t) 



(3.15) 



From ( ^.15| ) and (^.30| ) the conclusion of Lemma |3.9| follows. □ 
Let us state the main result of this section. 
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Theorem 3.10 At 



1. problem (1.1) has a unique solution y; 



2. F is w- continuous, twice Frechet differ entiable and inequalities (3.1), (3.1c) hold; 

3. e{t) > is continuously differentiable and monotonically tends to 0, 



(3.16) 



4- 



N2\W-y\\ 

1-a 



max < 1 , 



2Ce 

1-a 



5. $ is defined by (3.&). 



(3.17) 



Then Cauchy problem (2.6) has a unique solution z{t) for t £ [0, +oo) and 
\\zit)-xit)\\<^^eit), lim ||z(t)-y||^0. 



(3.18) 



Remark 3.11 First notice that Theorem 3.1L establishes convergence for any initial ap- 
proximation point zo if £{t) is appropriately chosen. To make an appropriate choice of e{t) 
one has to choose some function e{t) satisfying condition 1 3. It ). Examples of such functions 
e{t) are given below. One can observe that condition ( 3.ldi ) is invariant with respect to a 
multiplication e{t) by a constant. Therefore one can choose e{t) satisfying condition (3.17) 
by a multiplication of the original e{t) by a sufficiently large constant. If ^"^ffJ is not in- 



creasing, then m 



condition ( 3. 1 '\ ) :~ maxj 



e[o,< 



m\m\ 



can be replaced by :— 



e{0} 



Remark 3.12 In order to get an estimate of the convergence rate for \\x{t) — y\\ one has 
to make some additional assumptions either on F(^x) or on the choice of the initial approxi- 
mation zq. Without such assumptions one cannot give an estimate of the convergence rate. 
Indeed, as a simple example consider the scalar equation F(^x) :— a;™ = 0. Then one gets 
the following algebraic equation for x{e): 

F^{x) := x"" + e{x - Zo) = 0. (3.19) 

Assume m is a positive integer and zq > 0. It is known that the solution to this equation 
is an algebraic function which can be represented by the Puiseux series: x = X]j!Li '^j^'' 
some neighborhood of zero. Thus x = ci£p (1 + 0(e)) as e 0. Now from ( [,?._?£[ ) one gets: 

c'^ef (1 + 0(e)) + cie^+p (1 + 0(e)) = z^e. 
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Thus p = m, ci = Zq" and x{e) = ^^o'e™ (1 + 0(e)). For e = one gets the solution y = 0. 
Therefore 

\x{e)-y\^e^, e ^ 0, (3.20) 

where m can he chosen arbitrary large. 

Below in Propositions 3. IS and 3.14 some sufficient conditions are given that allow one 
to obtain the estimates for \ \x{t) — y\\. 



Proof of Theorem 3.10 Choosing /i(f) = where A is a constant, from conditions 



( 2.11 ) and ( 2.31 ) one gets the following inequalities: 

\m\ 



'e2(t) - A 



Choose 



A := 



s{t) 

N2 



e{t) 

, A||zo-x(0)|| <e(0). 



1-a 



(3.21) 
(3.22) 

(3.23) 
(3.24) 
(3.25) 

Thus from ( |3^ ), ( |3^ ) and ( ^ ) one obtains the second inequality m ( |3.22D . Using ( |3.17D 
once again, one gets: 



It follows from ( |3.16D that ( |3.2lD holds. From ( |3.17D one gets: 

N2\\zo - y\\ 



e(0)> 



1-a 



On the other hand from (3^) it follows that 

lko-a;(0)|| < ||zo-y| 



This inequality and (3.16) imply: 

A = 



N2 ^ l-C, 



1-Ce 2||zo-y| 



7W) 



By (3.16) one gets 



1-a 



< 



MM 

e{t) 



(3.26) 



(3.27) 



(3.28) 



2|ko-2/||^' 

The first inequality in (3.22) is equivalent to ( ^.2§| ) for A chosen in (3.23). Therefore one 
gets inequality (3.18) by applying Theorem 2.4, while the second relation (3.18) follows from 
(^), inequality (3.18|) and the triangle inequality: 



Ht)-y\\ < \\z{t)-xm + \Ht)-y\\. 



13 



Theorem ^.10| is proved. □ 
Examples. 

1. Let e{t) = eo{to + t)~'^, eq, to and i/ are positive constants. Then Ce — and 
condition ( 3.16| ) is satisfied if j/ e (0, 1] and to > v. 

— , .\ , then Cf 

log(io+t) ' 



2. If £(t) 

tologto > 1. 



to log to 



and condition (3.16) is satisfied if 



Note that if eit) — ege then condition (3.16) is not satisfied. 



Proposition 3.13 Let the assumptions of Theorem 3.1L hold. Suppose also that the fol- 
lowing inequality holds: 



{F{h),h-y)>c\\h-y\\^+'^, a>0. 



Then for the solution z{t) to problem (2.t) the following estimate holds: 

\\z{t) ~ y\\ ^ O (^eHt)) . 



(3.29) 



(3.30) 



Proof Denote \\x(t) — y\\ :— g{t). Since F{y) — 0, inequahty ( ^ ) imphes 

cg'+'^it) + e{t)g\t) < eit)\\zo - yMt) (3.31) 
and g(t) ^ as t — > +oo. This inequahty can be reduced to 

cg''it)+e{t)g{t)<em^o-y\\. (3.32) 

Thus g'^it) < ^2^e(t), and 

"\zo - y\ 



Mt)^y\\ < 



sHt). 



(3.33) 



Combining this estimate with estimate (3.18) for \\z{t) — x(t)\\ one completes the proof. □ 
Example. In the case of a scalar function f{h) and even integer a > the estimate 
f(h){h — y) > c\h — yl^"*"" means that f{h) — {h — y)'^g{h), where g{h) > c > 0, and hence 
y is a zero of the multiplicity a for /. 



Proposition 3.14 Let all the assumptions of Theorem 3.1L hold and there exists v £ H 
such that 

zo-y = F'{y)v, \\v\\<^- (3.34) 



Then for the solution z{t) to problem (2.t) the following convergence rate estimate holds: 

'l-Ce , 4|H| 



\W)~y\\< 



No 



sit). 



(3.35) 
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Proof From (3.3) for an arbitrary e > one gets 

F{x) ~ F{y) + e{x - y) ^ e{zQ - y). 
Therefore by the Lagrange formula one has: 



{F'{y + s{x - y))ds + el } {x - y) ^ e{zo - y). 



(3.36) 



Introduce the notation Qe{x) :— J {F'{y + s{x — y))ds + eL From ( 3.36| ) it follows that 



llx - y|| = e\\QjHx)Qoiy)v\\ < e\\Qj\x){Qoiy) - Qeix))v\\ + e\\Q-\x)QAx)v\l 
Since Qe(x) — Qq{x) + e/, one obtains 

lla: - y|| < e\\Q~\x){Qo{y) ~ Q^{x))v\\ + e\\Q-\x)ev\\ + e\\v\\ 



N2 

< ^||x-2/||||z;|| + 2£||i;| 



(3.37) 



So, from ( 3.1S| ), ( p. 34 ) and (3.37) for e — e{t) and correspondingly x = x{t) satisfying the 
assumptions of Theorem 3.10| one concludes that estimate (3.35) holds. □ 



Now we describe the simple iteration scheme for solving nonlinear equation (1.1 ). Define: 
^{h,t) := -[F{h) + e{t){h^ zo)], e{t) > 0. (3.38) 



Lemma 3.15 Assume that F is monotone, $ is defined by (3.38), and x{t) is a solution 
to problem Ii3.!^ ) with e — e{t) > 0, i G [0, +cxd). Then for the positive function 7(i) := e{t) 
and for a{t) = a{t) = estimate ( 2.3(\ ) holds. 



Proof Since x{t) is a solution to problem (3^), by the monotonicity of F one has: 
($(/i, t),h~- x{t)) = -~iF{h) - F{x{t),h - x{t)) - e{t){h - x{t), h - x{t)) 

<~e{t)\\h-x{t)\\'^. (3.39) 

Lemma 3.15| is p roved. □ 



Lemma 3.15 



together with Lemma 3.16 presented below allow one to formulate the 



convergence result concerning the simple iteration procedure (see Theorem 3.17) 



Lemma 3.16 Let v{t) be integrable on [0, +00). Suppose that there exists T > such that 
v{t) e Ci[T,+cx)) and 



v{t) > 0, 



Then 



lim 

t — * + CX3 



<C, for te[T,+co). 



v{T)dT = -\-00. 



(3.40) 



(3.41) 
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Proof One can integrate (3.40) 



t t 
/ ^^^^^ - / * ^ 



and get 



4t <c(t-r) + -?-. 



Without loss of generality we can assume that C > 0, and then 

1 



Integrating this inequality one gets (3.41) and completes the proof. □ 
Lemmas 3.4 - 3.8 and Lemmas 3.15 ■ 



3.16 imply the following result. 



Theorem 3.17 At 



that: 



1. problem (1.1) has a unique solution y; 

2. F is w-continuous and monotone; 

3. F is continuously Frechet differentiable and 

||i^'(a:)|| <iVi, WxeH; 



(3.42) 



4- s{t) > is continuously differentiable and tends to zero monotonically as t ^ +oo, 
and lim4^+oo jjj^ = 0. 



Then, for $ defined by ( 3.3^ ), Cauchy problem (2^) has a unique solution z{t) all for 
t e [0, +oo) and 



lim \\z{t)-y\\^Q. 

t — >oo 



Proof In order to verify the assumptions of Theorem 2.4 we use estimate ( 3.39| ) to 
conclude that a(t) = ajt) = and -f{t) = e{t) in formula ( |2.30D . By ( |2.3lD P{t) = ||i(t)|| 
because a{t) — 0. By ( 3.10| ) 



P{t) = \\x{t)\\<^-^\\y-Zo\\. 
s{t) 



To apply Theorem ^.4| one has to find a function /i(t) e C^[0,+oo) satisfying (2.11) that is 



s{t) 



(3.43) 
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Such a function can be chosen as the solution to the differential equation 

m , e{t) ^ A\sit)\ 
ii^it)'^ ^Ji{t) e[t) ' 

where A :— 2\\y — zq\\. Denote p{t) Then 

Ami 



(3.44) 



m + e{t)p{t) = 



e{t) 



and 



P{t) = 



A 



e{s)\ I^^^'' 



sis) 



ds 



-J e{T)dT 



(3.45) 



J e(T)dT 

Since by Lemma 3.16| e° co as t 

from (3.45) and condition 4 that 



lim p{t) = lim 



oo one can apply L'Hospital's rule to obtain 

m\ 



0. 



Therefore p{t) tends to +oo. To complete the proof one can take /i(0) sufficiently small for 
the second inequality in ( [3.43 ) to hold. By Theorem 2.4 one concludes that ||z(i) — a;(i)|| 
BS t ^ +c» and by Lemma 3.7 that \\x{t) — y\ \ ^ Q as t +oo. Therefore it follows from 
the estimate: 

\\z{t)-v\\ < Mt)~xit)\\ + \\xit)^y\\, 
that \\z{t) -y\\^0 ast^ +oo. □ 

Remark 3.18 From the proof it is clear that one can get the estimate \\z(t) — x{t)\\ < 
—> as t ^ +00, and for the term \\x{t) — y\\ one can get the rate of convergence if 
some additional assumptions are made on F or on zq (see Propositions 3.15, 3.l\ , and also 
Remark [Olj. 



Remark 3.19 The result obtained in Theorem 3.17 is similar to the result in The 
assumptions in are slightly different. The method of investigation in ^ is based on a 
linear differential inequality which is a particular case of {2.1i) with a{t) = 0. This linear 
differential inequality has been used often in the literature by many authors. 



Examples. 

1. Le t e(t ) = eo{l + t)~'\ Eq and are positive constants. Then the assumptions of 
Theorem |3.17| are satisfied if e (0, 1). 

2. If e{t) — li^^i^, then the assumptions of Theorem 3.17 are satisfied. 

If e{t) = eoe°^ 



then condition 4 of Theorem 3.17 is not satisfied. 
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4 Regularized Methods for Non-monotone Operators 

In this section we discuss two approaches to the regularization of the Gauss-Newton-type 
schemes for nonhnear equations with non-monotone operators. To describe the first one, 



assume that F in (1.1) is compact and Frechet differentiable. Denote: 

T{h) F'*{h)F'{h), Te{h) := T{h) + e/. (4.1) 

Then T{h) is a nonnegative self-adjoint compact operator. Such an operator cannot be 
boundedly invertible if H is infinite-dimensional. One has: 

\\Tr\h)\\<-^ (4.2) 

for any e > 0. Define $: 

$(/i,t) := (P,(,)(0 -I){h- zo) - P,(^t)iOT~^l)ih)F'*ih)Fih), sit) > 0. (4.3) 



Here ^ H is a fixed element, which will be chosen so that inequality (4.6) (see below) 
holds, and 



j dE{s), (4.4) 

E{s) :— E{s^^) is the resolution of the identity of the self-adjoint operator T(^), and 

snp\\F'{h)\\<N,, (4.5) 

so that \\T{^)\ \ < Nl 
Lemma 4.1 Assume that: 



1. problem (1.1) has a unique solution y; 



2. $ is defined by ^■!\ ), F is compact, twice Frechet differentiable and inequalities (3.1c ) 
hold; 

3. there exist ^ (z H and Eq > such that 

c:= sup m{OTr\o{T{y)^m}\\<h m 

£e(0,£o] ^ 

4. 0< e{t) < eo. 



Then there exist positive functions a{t), 'y{t) and cr(i), t G [0, +oo), such that estimate (2.3L ) 
holds with x{t) replaced by y. 
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Remark 4.2 Condition ( |^.6p contains a priori information about a nonlinear operator F . 
This condition allows one to get a convergence rate for ill-posed problem (1.1). It is always 
satisfied in a well-posed case (for a boundedly invertible operator T) if ^ is sufficiently close 
to y. However it is not clear yet how restrictive this condition is, and how it is related 
to other conditions that one has to use in order to prove the convergence of the process in 
ill-posed cases. 



Proof of Lemma 4.1 Using the polar decomposition F'{h) — U{F'*{h)F'{h))2 ^ where 
U is a. partial isometry, one gets F'*{h) — T^U*, and, since \\U*\\ — 1, one obtains: 



\T;-^l^{h)F'^h)\\<\\T-^^{h)THh)\\<^^ 



i<s<+oo s + e{t) 2y^eit) 
Using (^^) and the relation 

F{h) = F{h) - F{y) = F'{h){h -y) + R{y, h), 



(4.7) 



(4.8) 



where ||i?(y, h)\\ < ^\\h — yjp, one gets 



mh, t),h^y) = m^t){0 -I){h-zo),h^y)~ {P,(,){i)T;^^{h)T{h){h -y),h^y) 

N2 



\h-yr<-\\h-yr + \\iP,^,)iO-I)iy~zo)\\\\h-y\\ 



+ e{t){P,it){OT^^l^mh ~y),h-y) + 
Also one has the following estimates: 

iiFe(t)(e)r-^,Ve)ii< 

and 



N-2 



4^ 



\h-y\ 



s>e(t) s + e{t) 2e{t) 
\\T{h)-T{y)\\ < \\F'*ih)[F'ih)~F'iy)] + [F'*ih)^F'*iy)]F'iy)\\ 



(4.9) 



(4.10) 



<2A^iA^2||/i-y||. (4.11) 

Thus, using the identity A^^ - B^^ = -B^^l^A- B)A-^ and inequalities ( [4.10| ), ( [4.1l| ), one 
obtains: 

e{t){Pe[t){i)T;^l^mh ~y),h-y)= e{tmit){i)T;^l^mh ~y),h~y) 
+ \\Peit){OTf^l~,m\mh)-Tiy)\\\\h-y\\' + \\P,^^^^^^ 



< ( 2 + ^) ll'^-yl 



N1N2 

e{t) 



\h-y\ 



(4.12) 



19 



Define: 



lit) ^i:=^-C; 



a{t) := 



(4.13) 
(4.14) 



sit) 4^^ 
:=||(Fe(t)(0-^)(y-^o)||. (4.15) 
These functions are positive i f (^^ ) holds. If e(t) ^ then a{t) +oo and a(t) as 



t — > +00. Comparing (4.£) - (4.15) with ( ^.30| ) and applying Lemma 2.2 one completes the 
proof. □ 



Theorem 4.3 Suppose that the assumptions of Lemma 4-1 cire satisfied and. 



1. Pin — Zq) = 0, where P is an orthonormal projector onto the null-space ofT((^) 

2. e(t) > is continuously differentiable, monotonically tends to 0, and 

\m\ 



Co ■= min < 7 



sit) 



>0, 



with 7 defined in ( 4-lS ); 

3. Ca := e(0)maxtg[o,+oo) {t§^'] 
4- e(0) is chosen so that 



< 00; 



4iViiV2 + A^2\A(0) 
2Co 



< e(0) min 



1 



Co 



2Ca ' \\y- Zq\ 



Then Cauchy problem (2.6) has a unique solution z{t) fort G [0,oo) and 

2Co 



Mt)-y\\< 



AN1N2 + N2y/e{0) 



sit). 



(4.16) 



(4.17) 



(4.18) 



Remark 4.4 // T{^) is injective then Condition 1 is satisfied automatically. 



Remark 4.5 From (4.1' ) one can see that a depends on y and cannot he known a priori. 
However it follows from condition 1 of Theorem j| that ait) —f as t +00. Therefore in 
numerical applications of this scheme one should try different functions eit) (and different 
points Zq ) to satisfy condition 3. Then, since Cq and Ca are invariant with respect to 
multiplication of eit) by a positive constant, one can choose e(0) sufficiently large in order 
to satisfy condition 4- Such a choice can be done for an arbitrary zq. 
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Proof of Theorem 4.3 Since x{t) = y in our case, one gets f3{t) = a{t). Let us choose 
lj,(t) :— Conditions of Theorem can be written as follows: 



N1N2 



No 



< 



A 



\\\y - zoW < e{Q). 



\m\ 



sit) 



2\ 



\m\ 



e{t) 



Inequality (4.19) is equivalent to the following one: 



Take 



A > 



A := 



27 



MM 

e(t) 



miN2+N2^/dfi) 



2Co 



(4.19) 
(4.20) 

(4.21) 

(4.22) 



Then ( 4.21 ) follows from ( 1.22 ), from the monotonicity of e{t) and from ( A.li ). Inequality 
( 4.17 ) implies that 

< ^° . .... (4.23) 



ANiN2 + N2y/d^ 



2Co 



If A is defined by (4.22), then one has: 



max 



tG[0, + oo) 1^ e{t) 



2maxtg[o,+oo: 
a{t) 



I e{t) / 



< 



9i 

2A' 



From ( [l.l(j ) it follows that the first inequality in ( 4.2Cl| ) holds. Finally, one obtains from 
( p^ ) that 

4iVi7V2 + iV2v/^ e(0) 



2Co 



< 



\y- M 



which implies the second inequality in (4.2C). Since x{t) = y and /i(i) by (2.37) and 
( [4.22| ) one concludes that ( [4.18| ) holds. □ 

Consider now a variant of Gauss-Newton continuous method with $ defined as follows: 

^{h,t) ■.= -T-l^ih){F'*{h)Fih)+e{t)ih-zo)}. (4.24) 

Here F is not assumed compact. The following lemma is a consequence of Theorem 2.3 in 
[| (see also Theorem 2.4 in §). 

Lemma 4.6 Assume that: 



1. problem (FJ) has a unique solution y; 
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2. $ is defined by (^..24), F is twice Frechet differentiable and estimates (3.15) hold; 

3. zo is chosen so that, for some v H , one has: 



(4.25) 



I sit) > 0, 



where 



1 1 /v2(«+i) 



hii <i, 



Then for x(t) = y estimate (2.3C ) holds with 



ait):=eHt)CHl-Cy-'^\\v\l a{t) -.^ 



(4.26) 
(4.27) 



Remark 4.7 The convergence theorem in the case ( = 1 for continuous Gauss-Newton 
method is proved in Theorem 2.3]. For the discrete Gauss-Newton method the case 
< C < is analyzed in ^ under some additional assumptions on the operator. For the 
noise-free case it is shown that the rate of convergence is o(£^). 



Proof of Lemma |4.6| From ( |4.8| ) and ( [4.25D one gets 

mh,t), h-y)^ ~{T7^^{h)[F'*{h)F'{h) + e{t){h - y) + e{t){y - z^)],h - y) 

<~\\h- yiP + -^\\h -yf- s{t){T-^l^ih)THy)v, h - y). 

Following 1^ one estimates the inner product: 

iT~^l^ih)T'^{y)v,h^y)^iT-^l^ih)[T{y)-T{h)]^^^^^^ 

From the spectral theorem for selfadjoint linear operator T{ri), and for any rj ^ H, one gets: 
||T-V,)TC(,)|| < max-^ . ^T^- (^-^S) 

T{h) - T(y) = F'*{h)[F'{h) - F'{y)] + [F'*{h) - F'%y)]F'{y) 
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and ^ < C ^ from the polar decomposition one gets the estimate 



\\THv)T-,}MT<m< 



< 



2(C+*) 



Nf>s>o s + e{t) ~ Nf + e{t) ' 
which impHes 

\\T;^^{h)[T{y)~T{h)]T;^l^{y)T^{y)\\<\\T;^^^^^ 

+ \\T-^)ih){F'*ih) ^ F'^y))F\y)T;^^iy)T^ 



< 



Therefore one obtains: 



^2 C^(l-C)'"'^ , N2 



2(C+i) 



2^ e{t)Nf+e{t) 



\h-y\ 



mh,t),h~y)<eHt)CH^-Cy-'\M\\h~y\\ 



i-Ci 



□ 



Remark 4.8 Note that assumption {4--25} is not algorithmically verifiable. However, prac- 
titioners may try different Zq and choose the one for which the algorithm works better, that 
is convergence is more rapid and the algorithm is more stable. 

Assumptions of the type { 4-.2^ ) (sourcewise representation) became popular recently, be- 
cause they allow one to establish some error estimates for the approximate solution. But 
one has to remember that the results based on su ch as sumptions are of l imite d value because 
one has no algorithm for choosing zq for which ( 4-2^ holds, and y in ( 4--23i ) is unknown. 

If T = T* is compact and the null space N(T) — {0}, then the range R{T) is dense in 
H , so in any neighborhood of y there are points zq for which (4-.2L ) holds. On the other 
hand, since R{T) is not closed in the same neighborhood there are also points Zq for which 
{4.2L ) fails to hold. This is why the methods for solving nonlinear ill-posed problems, based 
on the assumption ( (.2^ or similar assumptions are not quite satisfactory although they 
might work in practice sometimes, for reasons which are yet not clear. 

In general, in order to get a convergence theorem in an ill-posed case one needs some 
additional assumptions on the Frechet derivative of the operator F, for example condition 
(4-t), or (4.25), or some other condition ( see e.g., paj, condition (2.11)). 



Theorem 4.9 Let the assumptions of Lemma 4.t be satisfied and 



1. e{t) is continuously differentiable, monotonically tends to 0, and 

\m\' 



Co '.— min 

te[o,+oc 



lit) - c- 



e{t) 



> 0, 



(4.30) 



with 7(i) defined in (4.21); 
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2. zo and e(0) are chosen so that 



2Co 



< mm 



Co 



2CC(l-C)i-«l|f|ni2/-^o|| 



Then the Cauchy problem (2.t ) has a unique solution z(t) for t G [0, +00) ana 



Mt)-y\\< 



2Co 



(4.31) 



(4.32) 



Proof Choose ii{t) 



jrij)- Conditions of Theorem 2A can be rewritten as follows: 



4^/dt) - 2eC{t) 



e[t) ) ' 



,<a-c,-<,H.i,(.(0-cH|), 



Inequality ( 4.33[) is equivalent to the following one: 

N2e^'^{t) 



(7(t)-C 



< X. 



If one takes 



A := 



e(t) 
iV2£'^~^(0) 

2Co ' 



(4.33) 
(4.34) 

(4.35) 
(4.36) 



then (4.35) follows from (4.36), from the monotonicity of e(t) and from (4.30). Inequality 
(4.31) implies that 



2Co 



< 



Cn 



2CC(i-C)i-'^l 



For A defined by ( 4.36 ) inequality ( 4.37 ) can be written as 



cHi-cy-'\\v\\<^. 



(4.37) 



(4.38) 



From ( p8| ) one obtains the first inequality ([4. 34]). Finally, from ([4.31D one concludes that 



A^2e^"^(0) ^ £^^(0) 



2Cn 



\y- zo\ 



which is equivalent to the second inequality (4.34) for A defined by ( 4.36| ). Since x{t) = y 
and fj,(t) := j^^, by ( ^-37 ) and ( 4.36 ) one gets estimate ( 4.32| ). □ 
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Remark 4.10 One can take x{t) in Theorem as the minimizer of the problem 

\\F{x)\\'^ +e{t)\\x- zn\\^ = 'wd, xeH, < e(t) ^ 0, as t +00, (4.39) 

instead of taking x{t) = y. Problem { 4.3!\ ) is solvable for w-continuous operator F and 
limt^oo \ \x{t) — y|| = 0. // one can obtain the estimate: 



then one can prove that 



\F{xm\^0{e{t)), 

\m\ 



\m\\ = o 



sit) 



(4.40) 



(4.41) 



and estimate (2.3C) holds. However we do not have examples of nonlinear operators F(x) 
satisfying estimate (4--4Q f^^d such that F' {y) is not boundedly invertible. 



5 Numerical Example 



The aim of this section is to illustrate the efhciency of scheme (2.6) with $ defined in (3.2) 



and in (4.24) for solving a practically interesting ill-posed nonlinear equation. 



Consider the following iterative process 

ffj-.z (-^ ' ) 

for a differentiable function /^.^ depending on two parameters fj, and z with the only maxi- 
mum at the point x. This process is characterized by the Feigenbaum constants: 

Oy = lim — — , Qfr — lim 



where [ij are the critical values of parameter /x, for which a doubling of the period of the 
function /^_2 occurs (the appearance of 2-' cycle), and d^ is the algebraic distance (could 
be negative) between zero and the nearest attractor (the limit point in 2-' cycle). The 
calculation of olz is a problem of a practical interest because it is not known yet if they 
satisfy any algebraic relations or not. As it is shown in olz can be found from the 
following nonlinear functional equation: 

aA^) = -oizdz {gz (^~)) ^^-^^ 

with the unknown function g^ and the initial condition g(0) = 1. Then 

= Xr-y (5.2) 

Functional equation ( |5.l|) does not have in general a unique solution. In |]l0|| numerical 
results are given which suggest, according to [|loj, that in certain restricted classes of analytic 
functions the solution to (pj) is unique. 
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In |10| the constants az are computed with high accuracy on a class of even concave 
functions analytic on [—1, 1] for integer z, 2 < z < 12. Approximate solutions of (5.1) are 
constructed as polynomial approximations: 



9 Ax) 



E 



where qi are the solutions to the following nonlinear system: 




qi\Xj 



i=l 



0, (5.3) 



where Xjave obtained from the partition of the segment [0, 1]. 

In 1121 classical Newton's method is successfully applied to a numerical solution of system 
( ^.3| ) and computation of for z = 2, . . . , 12. For z > 12 constants az are not found in 

The goal of our experiment is to calculate az for z — 2, . . . , 12 ( and to compare with 
[|0|) and also for z > 12 using schemes (|2j) - (^) and (|^ - ( |4.24| ). The function gzix) 
is even, therefore it is sufficient to find it on [0, 1]. Since uniform partition of [0, 1] works for 

small z only (z = 2, 3), the nonlinear partition xj :— (^) ' is chosen. 
The Jacobi matrix 



F' := 



dFi 



dqi 



E 



E* 



a+E 



qi)Xj 



i=i 



1 



(1 



1=1 



qi)Xj 



zi—1 



+ > Xj 



i=l 



qizi 



1 



E* 

i=l 



is strictly ill-posed for z > 2 and n > 2. The condition nu mbe r for any fixed n increases 
about ten times as z is replaced by z + 1. Therefore solving (5^) for large z and n > 2 is a 
very unstable problem to which the standard numerical methods are not applicable. However 
our methods, based on Theorems 2.4, 3.10 and 4.9, do work and yield the Feigenbaum 
constants az for z = 2, 26. 

For a more accurate approximation of one has to take n large enough, but then the 
problem of the choice of an initial approximation occurs: for z = 2,n = 2orn = 3 system 
(5.2) has many solutions. By this reason the scheme described in 0| is used. First, system 
(5.2) is solved for n = 1, then the solution of (5.3) with n = 1 is taken as the initial guess 
for the case n = 2, etc. When z = 2, n = l, a; = l system (5^) is reduced to one algebraic 
equation with respect to gi: 



H + iql + 2gi 



1) = 



and the two obvious solutions are q^^^ — 0, q\ 



.(2) 



-1. Since the function gz{x) is even 



and concave, the initial condition 52(0) = 1 implies 52(1) < 1, that is 1 + qi < 1, qi < 0. 
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Therefore one has to find the negative roots of the equation: 



ql + 3qj + 3ql + Sqj + 2gi - 1 = 0. 



Such roots are: qf^ = -1.8597174..., g^"*^ = -1.4021968.... Thus for the system of two 
equations (z = 2, n = 2) the initial data are: 

1. qi = -1, (72 = 0; 

2. qi = -1.8597174..., q2 = 0; 

3. qi = -1.4021968..., = 0. 



In the first two cases the solutions to (5.3) (z = 2, n = 2) are not concave on [—1, 1]. In the 
third case the graph of the polynomial is concave and 

g2ix) w 1 - 1.5416948a:2 + 0.1439197a;''. 

For the system of three equations {z — 2, n — 3) the initial data are: 

qi = -1.5416948, = 0.1439197, qs = 0. 

Then we continue this process. The maximum dimension we take is rt = 12. If n ~ 13, the 
discrepancy is not less than for n = 12, and after n = 14 it grows. 

For z = 3 we begin the computation with one equation {n = 1) also. As the initial 
approximation qi = —1.4021968 is taken, that is the solution to (5.3) with z = 2, n = 1. 
The dimension increases step by step till the discrepancy improves. For z — 3, n — 1 the 
solution to (5.3) with z = 3, n = 1 is used, etc. In our experiment az for z = 2, ... ,26 
are found. For z = 2, . . . , 12 they coincide with proposed in [10|. Below the values of 
ai3 — a26 are presented (the values of a2 — 0:12 can be found in [10|). As the exact digits 
the ones that were the same as the result of both regularized procedures were taken. 



ai3 



-1.22902, ai4 = -1.21391, ais 



4.20072, ai 



-1.18910, 



an = -1.17879, aig = -1.16957, aig = -1.1612, aao = -1.1537, 
aai = -1.1469, a22 = -1.140, 0123 = -1.134, a24 -1.129, 
025 = -1.124, 026 = -1-12. 



Our numerical results indeed demonstrate the efficiency of procedures (2.6) - (3.2) and 



(2^) - ( 4.24 ) and give Feigenbaum's constants for much larger range than in [[10[, which 
is of some practical interest. Contrary to the original conjecture | |T5[ | our numerical results 
confirm the conclusion of [|l^ , which says that the Feigenbaum constants in fact depend on 
the parameter z. 
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6 Appendix 

Here we prove a lemma about nonlinear differential inequalities. As we have shown in the 
previous sections, such inequalities are very useful in applications. 

Lemma 6.1 Let u e C^[0, +00), u{t) > for t > 0, and 

u< -a{t)f{u{t)) + b{t), for t>0, u{0) = uq. (6.1) 

Assume: 

1) ait), b(t) e C[0, +00), a{t) > 0, h{t) >0 fort>0, 
^) a{t)dt = +00, ^ -> as t -> +00, 
3) fe C[0, +(X3), /(O) 1 0, f{u) >Oforu>0, 
4-) there exists c > such that f{u) > c for u> 1. 
Under these assumptions (6.1) implies 

u{t) ^0 as i -> +00. (6.2) 



Remark 6.2 This Lemma is essentially Lemma 1 from J^. We have added condition 4) 
and changed the proof slightly. Condition 4-) omitted in Without condition 4 the 

conclusion of Lemma 1 in ^ is false as we show by a counterexample at the end of this 
Appendix. Condition 4) is equivalent to the condition f{w) implies w ^ 0. 

Assumptions about smoothness of a{t) and b{t) in ^ are not formulated. In Lemma \6.\ 
we assume that these functions are continuous and a{t) > 0. The continuity assumption can 
be relaxed, but in applications it is not restrictive, .since wc deal with the inequality. 

t 

Proof By assumptions 1), 2), the new variable s — s{t) :— J a{T)dT, maps t £ [0, +00) 





onto s e [0, +00). Write ( |6.l| ) as 



^ <-fiw{s))+l3{s), for s>0, wiO) = uo, (6.3) 

where w{s) :— u{t{s)) and /3(s) = tft(s)) ^ as s ^ +00. 
The lemma is proved if one proves 

w{s) as s ^ +00. (6.4) 

Let k(s) G C[0, +00) be an arbitrary function such that k(s) > 0, k(s) ^ as s — > +00 and 
J~^°° K{s)ds — +00. For example one can take k{s) — Define subsets of R+ :— {s : s > 
0} as follows: 

E -.^ {s : s> OJ{w{s)) - P{s) < k{s)}, F:=R+\E. (6.5) 
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Claim: 



sup E — +00. 



We prove ( |6^ ) later. 

Assuming (|6.6|), consider si S (si,S2) C F. Then 

— f{w{s)) + /3(s) < — k(s) for Si < s < 82- 



From ( |6.3[ ) and ( |6.7D one gets 



ds 



< —k{s) for si < s < 32- 



Therefore for si < s < S2 one has 

w{s) < w{si) — / K{T)dT < w{si) for si < s < S2, s £ F. 



Since si G E one has 

f{w{si)) < k{si) + /3(si) — ^ as si — > +00, si e E. 

Here we h ave u sed the assumptions k{s) and f3{s) ^ as s — s- +00. 
From ( |6.10 ) and assumption 4) it follows, that 

w{si) — > as si — > +00, si G E, 

and from (^|^) and ( |6.11 ) it follows that 

w{s) — > as s +00, s G i^. 



Thus, to prove Lemma it is sufficient to prove (6.6). 

Suppose (3.£) is false, that is supi? — < +00. Then 

f{w{s)) — /3(s) > k{s) for s > S3. 



From (p.3\) and (6.13) one gets 



Thus 



dw 
ds 



< —k{s) for s > S3. 



w{s) < t«(s3) — J K(r)(ir —00 as s ^ +00, 

S3 

where we have used the assumption J^°° K{s)ds = +00. This contradicts the 



M > and proves Lemma 5.1 



□ 
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The following example (which is a counterexample to Lemma 1 in |^) shows that con- 
dition 4) of Lemma 3.1 is essential. 
Take 

{M, for < u < 1, o 
ait)^l, Kt) = -—, (6.16) 
e^"", for l<'u<+oo, ^'^'^ 

where c > is an arbitrary constant. 
One can check immediately that 

u{t) = 1 + log{t + c) (6.17) 

satisfies inequality (|0|). The choice c > e^^ guarantees that u{t) > for all t > 0. Clearly 
u{t) +00 as t ^ +00, so that conclusion ( |6.2| ) of Lemma ^]l| is false if condition 4) is 
omitted. 
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